Mott Insulators in the Strong Spin-Orbit Coupling Limit: 
Prom Heisenberg to a Quantum Compass and Kitaev Models 
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We study the magnetic interactions in Mott-Hubbard systems with partially filled t2g-levels and 
with strong spin-orbit coupling. The latter entangles the spin and orbital spaces, and leads to a rich 
variety of the low energy Hamiltonians that extrapolate from the Heisenberg to a quantum compass 
model depending on the lattice geometry. This gives way to "engineer" in such Mott insulators 
an exactly solvable spin model by Kitaev relevant for quantum computation. We, finally, explain 
"weak" ferromagnetism, with an anomalously large ferromagnetic moment, in Sr2lr04. 
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The transition metal compounds with partially filled 
d-levels have been the subject of extensive studies after 
the discovery of a variety of novel physical phenomena 
and a diversity of new phases [J, . In the undoped 
compounds a strong Coulomb repulsion localizes the d- 
electrons in Mott-Hubbard or charge-transfer insulating 
regimes The low energy physics of such insulators, 
in some cases, are described in terms of spin-only Hamil- 
tonians. This happens when the symmetry of the local 
surrounding of a transition metal (TM) ion is low enough 
to lift the orbital degeneracy of a d-level as in case of, e.g., 
high-Tc cuprates. However, often, a TM ion possesses an 
orbital degeneracy in addition to that originating from 
spin. Typically, the orbitals form a long-range-ordered 
pattern driven by Jahn- Teller or exchange interactions, 
and, being subject to a discrete symmetry, behave more 
like static (classical) objects compared to their spin part- 
ners. Magnetic properties of orbitally ordered systems 
depend on the symmetry of the occupied orbitals. In- 
deed, orbital ordering may stabilize various types of mag- 
netic phases [11 , as well as spin gapped states without any 
long-range spin order @, 0|- In other circumstances, the 
situation can be opposite: the orbitals may remain in 
a liquid state down to the lowest temperatures (due to 
strong quantum fluctuations), while the spins are slowly 
fluctuating about a long range ordered state 0, . 

In this Letter we want to discuss yet another situation, 
when a strong relativistic spin-orbit (SO) coupling entan- 
gles locally the spin and orbital degrees of freedom. The 
physics of such systems may drastically differ from that 
of compounds in which spin-orbit coupling is of a per- 
turbative nature, as the form of magnetic interactions 
is no longer dictated by a global spin SU{2) symmetry 
alone. The effects of a strong SO interaction on coop- 
erative magnetic phenomena has been discussed in the 
pioneering works by Kanamori on Fe^"*" and Co^^ com- 
pounds [lO|. In recent years, there has been a revival of 
interest in spin-orbit coupling in the context of exchange 
interactions fill . [13, EH, maenetoelectri c fl3 | and spin 
Hall effects [15|, Fermi-surface topology |16|, etc. 



The SO coupling is strongly enhanced for the late tran- 
sition metal ions such as Ir, Os, Rh, Ru. Indeed, optical 
absorption data on Ir*"*" impurities in SrTiOa suggests 
a fairly high value of the SO coupling A ~ 380 meV 
[l3|. This far exceeds possible intersite interactions be- 
tween the t2g orbitals and spins in the insulating iridates, 
and hence is able to lock them together forming a total 
angular momentum locally. In the following we focus 
on the systems composed of magnetic ions with a single 
hole in a threefold degenerate t2g-level, a low spin state 
of c?^-conflguration, such as Ir''+ or Rh^+ ions subject 
to a strong octahedral fleld. We formulate a superex- 
change theory for such systems and show that together 
with conventional interactions of predominantly Heisen- 
berg form, more exotic spin models such as the quantum 
compass model naturally appear as low energy Hamilto- 
nians. We suggest how to implement in such Mott insu- 
lators an exactly solvable model proposed by Kitaev , 
which exhibit exotic anyonic excitations with fractional 
statistics. We apply the present theory to the insulat- 
ing iridium compound Sr2lr04 0,123, El 111 exhibiting 
"weak" ferromagnetism (FM) with an anomalously large 
FM moment. 

Single ion Kramers doublet.- We first introduce the 
local magnetic degrees of freedom. In the low spin d^ 
configuration a hole resides in t2g manifold of xy, xz, yz 
orbitals, and has an effective angular momentum I — 1 
[13: |;,=0) =|xy), \h^±l) =-^{i\xz)±\yz)). The total 

moment M = 2s — I, where s is a hole spin operator. The 
single ion Hamiltonian Hq = XI ■ s + Al'^ consists of a SO 
coupling with A > and a possible tetragonal splitting 
A of the t2g levels. A > for an oxygen octahedron 
elongated along the z \\ c-axis. The lowest energy level 
of Hq is a Kramers doublet of isospin states |t) and ||): 



If) = sin0|O,T)-cos(?| + l,i) 
ll) = sin0|O,i)-cos(?|-l,T) 



(1) 



Angle 6 parameterizes the relative strength of the tetrag- 
onal splitting, with tan(26') = 2v^A/(A - 2A). Notice 
that the wave functions of the Kramers doublet are given 
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FIG. 1: (Color online) Density profile of a hole in the isospin 
up state (without tetragonal distortion). It is a superposition 
of a spin up hole density in |a;y)-orbital, — 0, (middle) and 
spin down one in {\yz) + i\xz)) state, Iz = 1, (right). 



by a coherent superposition of different orbital and spin 
states, leading to a peculiar distribution of spin densi- 
ties in real space (see Fig. [Ij . This will have important 
consequences for the symmetry of the intersite interac- 
tions. Namely, the very form of the exchange Hamilto- 
nian depends on bond geometry through a density profile 
of Kramers states, as we demonstrate below. 

Exchange couplings of neighboring Kramers states.- 
We consider the limit of the strong spin-orbit coupling, 
i.e., when A is larger than exchange interaction between 
the isospins. The exchange Hamiltonians for isospins 
are then obtained by projecting the corresponding su- 
perexchange spin-orbital models onto the isospin states 
Eq. ([1]). First, we present the results for the case of cubic 
symmetry (A = 0, sin 6* = l/^/3), and discuss later the 
effects of a tetragonal distortion. We consider two com- 
mon cases of TM-O-TM bond geometries: (A) 180°-bond 
formed by corner-shared octahedra as in Fig. [HJa), and 
(B) 90°-bond formed by edge-shared ones, Fig.[2I^b). 

(A) 180°-bond: For this geometry, the nearest- 
neighbor t2g hopping matrix is diagonal in the orbital 
space and, on a given bond, only two orbitals are active, 
e.g., \xy) and \xz) orbitals along a bond in x-direction 
[Fig. IHa)]. The spin-orbital exchange Hamiltonian for 
such a s yst em has already been reported: see Eq. (3.11) 
in Ref. [I4I. After projecting it onto the ground state 
doublet, we find an exchange Hamiltonian for isospins in 
a form of Heisenberg plus a pseudo-dipolar interaction: 



'Hij — JiSi ■ Sj + J2{Si 



(2) 



where Si is the 5=1/2 operator for isospins (referred to 
as simply spins from now on) , is the unit vector along 
the ij bond, and Ji{2) = 1^^1(2)- Hereafter, we use the en- 
ergy scale At^ /U where t is a (id-transfer integral through 
an intermediate oxygen, and U stands for the Coulomb 
repulsion on the same orbitals. The parameters 1^1(2) 
controlling isotropic (anisotropic) couplings are given by 
vi = (3ri + r2 + 2r3)/6 and 1^2 = (ri — r2)/4, where 
the set of r„ characterizing the multiplet structure of the 
excited states depends solely on the ratio rj ^ Jh/U oi 
Hund's coupling and U (2J]. At small 77, one has I'l ~ 1 
and f2 — r]/2. Thus, we find a predominantly isotropic 
Hamiltonian, with a weak dipolar-like anisotropy term. 
While the overall form of Eq. ^ could be anticipated 
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FIG. 2: (Color online) Two possible geometries of a TM- 
O-TM bond with corresponding orbitals active along these 
bonds. The large (small) dots stand for the transition metal 
(oxygen) ions, (a) 180°-bond formed by corner shared octa- 
hedra, and (b) 90°-bond formed by edge shared octahedra. 



from symmetry arguments, the explicit derivation led us 
to an unexpected result: In the limit of strong SO cou- 
pling, the magnetic degrees are governed by a nearly 
Heisenberg model just like in the case of small A, and, 
surprisingly enough, its anisotropy is entirely due to the 
Hund's coupling. This is opposite to a conventional situ- 
ation: typically, the anisotropy corrections are obtained 
in powers of A while the Hund's coupling is not essential. 

(B) 90°-bond: There are again only two orbitals active 
on a given bond, e.g., \xz) and \yz) orbitals along a bond 
in the xy-plane. However, the hopping matrix has now 
only non-diagonal elements and there are two possible 
paths for a charge transfer [via upper or lower oxygen, 
see Fig. (Hb)]. This peculiarity of a 90°-bond leads to 
an exchange Hamiltonian drastically different from that 
of a 180° geometry. Two transfer amplitudes via upper 
and lower oxygen interfere in a destructive manner and 
the isotropic part of the Hamiltonian exactly vanishes. 
The finite, anisotropic interaction appears, however, due 
to the J/f-multiplet structure of the excited levels. Most 
importantly, the very form of the exchange interaction 
depends on the spatial orientation of a given bond. We 
label a bond ij laying in the af3 plane perpendicular to 
the 7(= X, y, z) axis by a (7)-bond. With this in mind, 
the Hamiltonian can be written as: 



(7) 



-J5757 



(3) 



with J — %V2. Remarkably, this Hamiltonian is pre- 
cisely a quantum analog of the so-called compass model. 
The latter, introduced originally for the orbital degrees of 
freedom in Jahn- Teller systems |5|, has been the subject 
of numerous studies as a prototype model with protected 
ground state degeneracy of topological origin (see, e.g., 
Ref. I25I). However, to our knowledge, no magnetic real- 
ization of the compass model has been proposed so far. 

Implementing the Kitaev model in Mott insulators.- 
The Kitaev model is equivalent to a quantum compass 
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FIG. 3: (Color online) Examples of the structural units 
formed by 90° TM-O-TM bonds and corresponding spin- 
coupling patterns. Grey circles stand for magnetic ions, and 
small open circles denote oxygen sites, (a) Triangular unit cell 
of AB02-type layered compounds, periodic sequence of this 
unit forms a triangular lattice of magnetic ions. The model 
(131) on this structure is a realization of a quantum compass 
model on a triangular lattice: e.g., on a bond 1-2, laying per- 
pendicular to a;-axis, the interaction is SfSf . (b) Hexagonal 
unit cell of A2B03-type layered compound, in which magnetic 
ions (B-sites) form a honeycomb lattice. (Black dot: nonmag- 
netic A-site). On an ii-bond the interaction is SfSj, etc. For 
this structure the model ([3J is identical to the Kitaev model. 
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FIG. 4: The spin canting angle (j> (in units of a) as a function 
of the tetragonal distortion parameter 6. Inset shows a sketch 
of an Ir02-plane. The oxygen octahedra are rotated by an 
angle ±a about z-axis forming a two sublattice structure. In 
the cubic case, 9 ~ n/b, one has <j!> = a exactly. The spin-flop 
transition from the in-plane canted spin state to a collinear 
Neel ordering along z-axis occurs at 6 = n/A. 



model on a honeycomb lattice [26|. It shows a number 
of fascinating properties such as anyonic excitations with 
exotic fractional statistics, topological degeneracy, and, 
in particular, it is relevant for quantum computation [l^ . 
This generated an enormous interest in a possible realiza- 
tion of this model in real s yste ms, with current proposals 
based on optical lattices [27|. Here we outline how to 
"engineer" the Kitaev model in Mott insulators. 

Shown in Fig. ^a,) is a triangular unit formed by 90° 
bonds together with "compass" interactions that follow 
from Eq. ([3]). Such a structure is common for a num- 
ber of oxides, e.g., layered compounds ABO2 (where A 
and B are alkali and TM ions, respectively). The trian- 
gular lattice of magnetic ions in an ABO2 structure can 
be depleted down to a honeycomb lattice (by periodic 
replacements of TM ions with non-magnetic ones). One 
then obtains an A2BO3 compound, which has a hexago- 
nal unit shown in Fig. . There are three nonequiva- 
lent bonds, each being perpendicular to one of the cubic 
axes X, y, z. Then, according to Eq. ^ the spin coupling, 
e.g., on a (a;)-bond is of S'fS'J type, precisely as in the 
Kitaev model. The honeycomb lattice provides a par- 
ticularly striking example of new physics introduced by 
strong SO coupling: the Heisenberg model is converted 
into the Kitaev model with a spin-liquid ground state. 

The compound Li2Ru03 [28} represents a physical ex- 
ample of the A2BO3 structure. By replacement of spin- 
one Ru**^ with spin one-half Ir'*'*' ions, one may realize a 
strongly spin-orbit coupled Mott insulator with low en- 
ergy physics described by the Kitaev model. 

"Weak" ferromagnetism of Sr2lrOi.- As an example 
of a spin-orbit coupled Mott insulator, we discuss the 
layered compound Sr2lr04, a t2g analog of the undoped 
high-Tc cuprate La2Cu04. In Sr2lr04, a square lattice 



of Ir'*+ ions is formed by corner-sharing IrOg octahe- 
dra, elon gate d along the c-axis and rotated about it by 
a ~ 11° [l9| (see Fig. |4]). The compound undergoes a 
magnetic transition at ~ 240 K displaying a weak EM, 
which can be ascribed to a Dzyaloshinsky-Moriya (DM) 
interaction. The puzzling fact is that "weak" FM mo- 
ment is in fact unusually large, AfpM — 0.14/1^ [20] which 
is two-orders of magnitude larger than that in La2Cu04 
[2^ . A simple estimate gives a spin canting angle ~ 8° 
which is close to a, i.e., the ordered spins seem to rigidly 
follow the staggered rotations of octahedra. Here we 
show that the strong SO coupling scenario gives a natural 
explanation of this observation. 

We first show the dominant part of the Hamiltonian 
for Sr2lr04 neglecting the Hund's coupling for a moment. 
Accounting for the rotations of IrOe octahedra, we find: 



H^JS,- Sj + .hS^S^ + D-[SiX Sj] 



(4) 



Here, the isotropic coupling J — j/i(t^ — t^), where 
ts = sin^ ^ + i cos^ 9 cos 2a, and ta = \ cos^ 9 sin 2a. 
The second and third terms describe the symmetric and 
DM anisotropies, with = 2vit1^, D = (0,0, —D), and 
D — 2vitsta. [For a = 0, these terms vanish and we 
recover Ji-term of the 180° result As it follows 

from Eq. ([?]), the spin canting angle is given by a ratio 
D I J 2ta/ts ~ 2a which is independent of A, and is 
solely determined by lattice distortions. This explains 
the large spin canting angle (/) a in Sr2lr04. 

As in the case of weak SO coupling [sOj , the Hamilto- 
nian (jl]) can in fact be mapped to the Heisenberg model 

Si ■ Sj where operators S are obtained by a staggered 
rotation of S around the z-axis by an angle with 
tan(20) = D/J. Thus, at Jh ~ 0, there is no true mag- 
netic anisotropy. Once Jjy-corrections are included, the 
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Hamiltonian receives also the anisotropic terms: 



7i = J Si ■ S j 



-p 02 _1_ "P / 



sfsy) 



(5) 



where J 
,2 



+tl) +ri, Ti = i/2Cos26icos26i, T2 = 
1^2 sin~y cos^0, and a ± sign is taken for a bond along 
a;(y)-axis. This Hamiltonian supports two types of spin 
orderings (see Fig. [4]). For Fi > the spins form a canted 
structure in xy-plane. We find the out-of-plane magnon 
gap oc \/ JFi of a classical origin, and much smaller 
in-plane gap oc F2 generated by quantum fluctuations. 
Shown in Fig.[4]is the spin canting angle cj) (in units of a) 
as a function of tetragonal distortion. In the cubic limit 
(j) = a, i.e., the spins simply rotate together with the 
oxygen octahedra. This suggests a strong magnetoelas- 
tic coupling in Sr2lr04, and related phonon anomalies at 
the magnetic transition. The elongation c > a (compres- 
sion c < a) of octahedra leads to a decrease (increase) of 
(f> and hence FM moment. At large c/a ratio, Fi changes 
sign. This marks a spin-flop transition to coUinear or- 
der along the z-axis, which happens at 9 — 7r/4, i.e., 
A = A/2. This gives an upper estimate for the tetrag- 
onal splitting A < A/2 ~ 190 meV in Sr2lr04, which 
agrees with optical data [U, H^l . Further, in the cubic 
limit we find Fi /J ~ 0.04, which is much larger than that 
in La2Cu04, and far exceeds possible interlayer interac- 
tions [32,]. This suggests that XF-anisotropy is chiefiy 
responsible for finite transition temperature in Sr2lr04. 
From experimental value T/v — 240 K we estimate J ~ 45 
meV 33] , which is a realistic value for a i2g-system [l^] . 

We focused above on the Mott insulators [4|, where 
the energy Apd for a charge transfer from an oxygen to a 
TM ion is larger than U. Optical data show that the p-d 
transitions in Sr2lr04 are indeed located at much higher 
energy than d-d ones 2l|, |22|. We, therefore, neglected 
the processes with two holes on the oxygen sites 31). 

To conclude, we have considered magnetic interactions 
in Mott insulators with strong spin-orbit coupling. We 
find that the symmetry of low energy Hamiltonians is 
dictated by lattice geometry, opening a possibility to de- 
sign exotic spin models like quantum compass and Ki- 
taev models. Magnetic properties of the iridate Sr2lr04 
are explained. In general, spin-orbit coupled Mott insula- 
tors present an interesting new class of frustrated systems 
where the orbital, spin, and geometrical frustrations are 
superimposed via the spin-orbital entanglement, giving 
rise to unusual symmetries of interactions. 

We would like to thank B. Keimer, D.I. Khomskii, and 
J. Chaloupka for stimulating discussions. G.J. acknowl- 
edges support by GNSF Grant No. 06-81-4-100. 



[1] 

[2] 
[3] 
[4] 

[5] 

[6] 

[7] 

[8] 
[9] 

[10] 

[11] 

[12] 
[13] 
[14] 

[15] 

[16] 

[17] 
[18] 
[19] 
[20] 
[21] 
[22] 
[23] 



[24] 
[25] 

[26] 



[27] 



[28] 
[29] 
[30] 

[31] 



Also at E. Andronikashvili Institute of Physics, 
Tbilisi, Georgia 



0177 



[32] 
[33] 



M. Imada, A. Fujimori, and Y. Tokura, Rev. Mod. Phys. 
70, 1039 (1998).' 

Y. Tokura and N. Nagaosa, Science 288, 462 (2000). 
E. Dagotto, Science 309, 257 (2005). 
J. Zaanen, G. A. Sawatzky, and J. W. Allen, Phys. Rev. 
Lett. 55, 418 (1985). 

K.I. Kugel and D.I. Khomskii, Sov. Phys. Usp. 231, 25 
(1982). 

H.F. Pen, J. van den Brink, D.I. Khomskii, and G.A. 

Sawatzky, Phys. Rev. Lett. 78, 1323 (1997). 

G. Jackeli and D.I. Khomskii, Phys. Rev. Lett. 100, 

147203 (2008), and references therein. 

B. Keimer et ai, Phys. Rev. Lett. 85, 3946 (2000). 

G. Khaliullin and S. Maekawa, Phys. Rev. Lett. 85, 3950 

(2000); G. Khaliullin, Phys. Rev. B 64, 212405 (2001). 

J. Kanamori, Prog. Theor. Phys. 17, 177 (1956); 17, 197 

(1956). 

G. Khaliullin, W. Koshibae, and S. Maekawa, Phys. Rev. 
Lett. 93, 176401 (2004). 

G. Khaliullin, Prog. Theor. Phys. Suppl. 160, 155 (2005). 

G. Chen and L. Balents, Phys. Rev. B 78, 094403 (2008). 

H. Katsura, N. Nagaosa, and A.V. Balatsky, Phys. Rev. 
Lett. 95, 057205 (2005). 

S. Murakami, N. Nagaosa, and S.-C. Zhang, Phys. Rev. 
Lett. 93, 156804 (2004). 

M.W. Haverkort et al, Phys. Rev. Lett. 101, 026406 
(2008); G.-Q. Liu et ai, ibid. 101, 026408 (2008). 
O.F. Schrimer et ai, J. Phys. C 17, 1321 (1984). 

A. Kitaev, Ann. Phys. (N.Y.) 321, 2 (2006). 

Q. Huang et ai, J. Solid State Chem. 112, 355 (1994). 
G. Cao et al, Phys. Rev. B 57, R11039 (1998). 
S.J. Moon et ai, Phys. Rev. B 74, 113104 (2006). 

B. J. Kim et ai, Phys. Rev. Lett. 101, 076402 (2008). 

A. Abragam and B. Bleaney, Electron Paramagnetic Res- 
onance of Transition Ions (Clarendon Press, Oxford, 
1970). 

n = 1/(1 - 377), ra = 1/(1 - r,) and rs = 1/(1 + 2ry). 

B. Dougot et al, Phys. Rev. B 71, 024505 (2005); J. 
Dorier, F. Becca, and F. Mila, ibid. 72, 024448 (2005). 
The Kitaev model [3 is defined on a honeycomb lattice 
with the following rule: label the three nonequivalent 
links of honeycomb lattice as x, y, and z, and couple on a 
given link only the corresponding Cartesian components 
of spin operators, i.e., SfSj on x-links, etc. 

L.-M. Duan, E. Demler, and M.D. Lukin, Phys. Rev. 
Lett. 91, 090402 (2003); S. Trotzky et al, Science 319, 
295 (2008); A. MicheU, G. K. Brennen, and P. ZoUer, 
Nature Phys. 2, 341 (2006). 

Y. Miura et ai, J. Phys. Soc. Jpn. 76, 033705 (2007). 
T. Thio et al, Phys. Rev. B 38, 905 (1988). 
L. Shekhtman, O. Entin-Wohlman, and A. Aharony, 
Phys. Rev. Lett. 69, 836 (1992). 

For completeness, we notice that in the case of a 180°- 

bond, the p-d charge transfer contributions do not change 

the Hamiltonian ([2} and only lead to a trivial renormal- 

ization of the coupling constants. Conversely, on a 90°- 

bond, such processes generate a term J'{Si -Sj —2S^SJ), 

composed of Heisenberg and compass models (see also 

Ref.[il). We find f = ^ which is small in 

the Mott insulator regime of Apd S> Up,U. 

B. Keimer et ai, Phys. Rev. B 45, 7430 (1992). 

The estimate is based on Tjv-equation derived by V.Yu. 

Irkhin and A. A. Katanin [Phys. Rev. B 60, 2990 (1999)]. 



